Cross-Cultural Evidence for Multimodal Motherese: The Role of Temporal Synchrony between Verbal Labels and Gestures

نویسندگان

  • Lakshmi J. Gogate
  • Lorraine E. Bahrick
  • Ady Friedman
  • Susan Bewley
چکیده

Gogate, Bahrick, and Watson (2000) found that American mothers of pre-lexical infants (5-8 months) taught their infants novel words using temporal synchrony between the spoken words and objects' motions (multimodal motherese) more often than mothers of lexically advanced infants (21-30 months). In the present study, we examined the communicative interactions between Asian-Indian mothers and their infants living in India to obtain cross-cultural evidence for multimodal motherese. The results revealed a highly significant interaction between infants' age and maternal communication type, showing that Indian mothers adapt their bimodal communication to their infants' ability to detect word-referent relations. Mothers of pre-lexical infants used temporal synchrony more often than mothers of infants who were lexically advanced. Thus, the multimodal communication of Indian mothers, similar to that of American mothers, may serve to highlight word-referent relations for young infants. In contrast, mothers of lexically advanced infants named objects and actions while holding a static object more often than mothers of pre-lexical infants. These infants likely have other means for gleaning word-referent relations and may not require maternal highlighting of these relations. The findings provide converging and cross-cultural evidence for mothers' use of multimodal motherese when teaching their pre-lexical infants novel words that refer to objects or actions, and suggest that mothers adapt their communication to their infants' ability to relate words and their referents. Introduction Gogate, Bahrick, and Watson (2000) found that American mothers of pre-lexical infants (5-8 months) taught their infants novel words using temporal synchrony between the spoken words and objects' motions (multimodal motherese) more often than mothers of lexically advanced infants (21-30 months). These findings suggested that mothers' use of multimodal communication is adapted to their infants' ability to detect word-referent relations. Specifically, multimodal motherese may serve to highlight word-referent relations for infants at an age when they are unable to detect these relations on their own. In the present study, we examined the communicative interactions between Asian-Indian mothers and their infants living in India to obtain cross-cultural evidence for multimodal motherese. We were interested in whether in this South-Asian culture, where mothers do not explicitly teach words to their infants as in Western cultures, mothers still adapted their multimodal communication to their infants' lexical mapping ability. Method Twenty-four mothers and their infants participated. There were eight infants in each of three age groups, 5-8 months, 9-17 months, and 19-43 months. These age groups represented three levels of lexical-mapping development, pre-lexical, early-lexical, and advanced-lexical, respectively. Identical to the prior study (Gogate, Bahrick, & Watson, 2000), following a 5-min. free-play episode mothers were asked to teach their infants novel names (gow and chi) for two objects, and novel names (pru and flo) for two distinct actions, during a 5 min semi-structured play episode (Figure 1).

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A study of multimodal motherese: the role of temporal synchrony between verbal labels and gestures.

This study examined European American and Hispanic American mothers' multimodal communication to their infants (N = 24). The infants were from three age groups representing three levels of lexical-mapping development: prelexical (5 to 8 months), early-lexical (9 to 17 months), and advanced-lexical (21 to 30 months). Mothers taught their infants four target (novel) words by using distinct object...

متن کامل

Cross-cultural evidence for multimodal motherese: Asian Indian mothers' adaptive use of synchronous words and gestures.

In a quasi-experimental study, 24 Asian Indian mothers were asked to teach novel (target) names for two objects and two actions to their children of three different levels of lexical mapping development: prelexical (5-8 months), early lexical (9-17 months), and advanced lexical (20-43 months). Target naming (n=1482) and non-target naming (other, n=2411) were coded for synchronous spoken words a...

متن کامل

Synthesizing multimodal utterances for conversational agents

Conversational agents are supposed to combine speech with non-verbal modalities for intelligible multimodal utterances. In this paper, we focus on the generation of gesture and speech fromXML-based descriptions of their overt form. An incremental production model is presented that combines the synthesis of synchronized gestural, verbal, and facial behaviors with mechanisms for linking them in f...

متن کامل

A Grammar for Language and Co-verbal Gesture

Meaning in everyday communication is conveyed by various signals including spoken utterances and spontaneous hand gestures. The literature has attested that gestures function in synchrony with speech to deliver an integrated message, or a “single thought” [5], [1], exhibit language-specific properties [2] and are subject to formal semantic modeling [3]. One of the challenges in modeling synchro...

متن کامل

Timing and Rhythm in Multimodal Communication for Conversational Agents

Synthesis of lifelike gesture is finding growing attention in human-computer interaction. In particular, synchronization of synthetic gestures with speech output is one of the goals for embodied conversational agents which have become a new paradigm for the study of gesture and for human-computer interface (Cassell et al., 2000). Embodied conversational agents are computer-generated characters ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2010